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The opacity of typical objects in the world results in occlusion — an important prop- 
erty of natural scenes that makes inference of the full 3-dimensional structure of the 
world challenging. The relationship between occlusion and low-level image statistics 
has been hotly debated in the literature, and extensive simulations have been used 
to determine whether occlusion is responsible for the ubiquitously observed power- 
law power spectra of natural images. To deepen our understanding of this problem, 
we have analytically computed the 2- and 4-point functions of a generalized "dead 
leaves" model of natural images with parameterized object transparency. Surpris- 
ingly, transparency alters these functions only by a multiplicative constant, so long 
as object diameters follow a power law distribution. For other object size distri- 
butions, transparency more substantially affects the low-level image statistics. We 
propose that the universality of power law power spectra for both natural scenes and 
radiological medical images - formed by the transmission of x-rays through partially 
transparent tissue - stems from power law object size distributions, independent of 
object opacity. 
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I. INTRODUCTION 



Natural images are surprisingly statistically uniform. The autocorrelation function, a 
measure of how similar nearby pixels tend to be, is virtually universal for natural images^' 
(Fig. 1). This is typically quantified by measuring image power spectra (Fourier transform 
of the autocorrelation function), which are well-described by scale-invariant power law func- 
tions with power V and spatial frequency k related by V(k) oc k~ a , with exponents a ~ 2. 
The exponents a vary slightly from image-to-image, and there are small differences in aver- 
age exponent a between terrestria l 1 * 3 * 6 * and aquatic^ environments, and between natural and 
man-made ones^. 

Intriguingly, even radiological images like mammograms have power law power spectrsP, 
typically with larger a values, despite the fact that the physics of image formation are very 
different for radiological and natural images. In natural images, formed by reflection of 
light off of surfaces, objects tend to be opaque, and thus they occlude one another, whereas 
in mammograms, formed by the transmission of x-rays through breast tissue, objects are 
more transmissive and do not completely occlude one another. The statistics of radiological 
images have received less attention and are less well understood. 

The statistical regularity of natural scenes implies that engineers can design, and evolution 
might have selected for, coding schemes that exploit this structure^. Indeed, the peripheral 
mammalian visual system appears to exploit this homogeneity by using simple filters to 
decorrelate the incoming signaP^^ and more complex feature dictionaries to efficiently 
encode the decorrelated signaP^^. 

Using the intuition that the environment is composed of distinct objects, Ruderman stud- 
ied a "dead leaves" modeP^^for natural scenes, in which images are created by sequentially 
placing opaque, potentially overlapping circles of random brightness in random locations on 
a 2-dimensional image plane^ (Fig. 2A). Ruderman modeled correlations between pixels by 
assuming a different correlation function for points falling within a visible circle than for 
points falling in different visible circles. Using analytical calculations he demonstrated that, 
so long as the diameters s of the circles follow a power law distribution with probabilities 
p(s) oc s~^ 3+ri \ the images exhibit power law correlation functions, C(q) oc q~ v , where q is 
the separation between pixels, and power law power spectra, V(k) oc k'^ 2 '^. If the circle 
sizes are drawn from other distributions, Ruderman's analytical calculations suggest that 
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the power spectra that could be made to differ from a power law, contrary to the old notion^ 
that the 1/k 2 power spectra result from the mere presence of edges, each of which has al/fc 2 
1-dimensional power spectrum (cf. Balboa et alJ-^). More recently, Balboa et al.^ simulated 
the analytical examples presented by RudermarP^, including images with the exponential 
distribution of object sizes that was claimed^ to yield non-power-law power spectra. They 
found that these images had nearly power law power spectra, and subsequently reiterated 
the previous claim that occlusion, and not object size distributions, are the cause of power 
law power spectra in natural images. 

This "edges vs. size distributions" debate was subsequently resolved when Hsiao and 
Milane demonstrated, via numerical simulations, that dead leaf models with partially trans- 
parent objects (and thus only partial occlusion) whose sizes follow a power law distribution 
yield power law power spectra, and that dead leaf models with opaque objects from other 
size distributions can have non power-law power spectra^. In other words, occlusion is nei- 
ther necessary, nor sufficient, to yield power law image power spectra. In the same paper, 
Hsiao and Milane computed the power spectrum of a simplified ensemble of images formed 
by summing the intensities of different randomly placed disks. This model was simpler than 
the images with partially occluding leaves that they simulated. The linearity of this model 
makes it relatively straightforward to compute the Fourier transform of the model images, 
and thus to estimate the power spectra. 




FIG. 1. Natural images have nearly identical scale invariant power spectra. Even very 
different natural images (A,B) have similar rotation-averaged power spectra that each follow a 
power law (C). Line colors in panel C match the borders of corresponding panels A and B. 
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Thus, to date, the 2-point statistics of dead leaf image models have been analytically 
calculated for both fully opaque leaves^, and for fully transmissive leaves®'. What remains 
is to solve for the 2-point function of images with partial occlusion, which will deepen our 
understanding of how opacity and image statistics inter-relate along this continuum of ob- 
ject properties. Thusly motivated, we studied a generalized dead leaves model, in which the 
leaves have variable transparency. While general feature probabilities have been solved ex- 
actly for the fully opaque dead leaves model 21 , our transparent generalization requires other 
methods and has not previously been systematically explored. We show herein that, so long 
as leaf sizes follow a power-law distribution, transparency results in an overall multiplica- 
tive factor in the 2- and 4-point functions but does not change their functional (power-law) 
form. For other size distributions, transparency does change the form of the autocorrelation 
function, suggesting that power-law size distributions, unify the observed power spectra of 
natural and radiological images. 

II. ANALYTICAL CALCULATION OF THE 2-POINT FUNCTION IN 
THE TRANSMISSIVE DEAD LEAVES MODEL 

We begin by analytically computing the 2-point functions of images in our "transmissive 
dead leaves" environment. For image pixels values I(x), the 2-point function is given by 
C(x,x') = (I(x)I(x')) = C(\x — x'\), where the angle brackets denote averaging over images 
drawn from this ensemble and the second step stems from the fact that, since our model 
world is invariant under both translations and rotations, the 2-point function depends only 
on the distance \x — x'\ = q between sample points. 

The image is formed by randomly placing a circle whose diameter s is drawn from some 
distribution, with brightness value b, and transparency a, on a surface of diameter L. The 
brightnesses b will be drawn from a zero-mean distribution, and the transparencies a G [0, 1] 
can also be random. A value a = 1 specifies a fully transparent (invisible) circle, while 
a value of a = specifies a fully opaque circle, as in Ruderman's modeP^. When a new 
circle is added, the pixel value I(x) at a point x that falls within the circle undergoes the 
transformation 

I(x) (1 -a)b + al(x). (1) 
Pixels not lying under the circle are unaffected by its addition. This process is continued ad 
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infinitum to create model images (Fig. 2). 




FIG. 2. For power law object size distributions, the 2-point statistics of opaque and 
transmissive dead leaves images differ by a multiplicative constant. (A) A representative 
image from the opaque (a = 0) dead leaves model with circle diameters drawn from the distribution 
p(s) oc s -3 ' 2 for s > so = 1 pixel and circle brightnesses drawn uniformly within b £ [—1,1]. (B) 
When the circles are partially transparent (a = 0.25 for all circles), but all other parameters 
are the same, previously occluded circles are partially visible. (C) A higher level of transparency 
(a = 0.75) results in an image that begins to approximate Gaussian pink noise, as expected from the 
central limit theorerrP^. (D) Autocorrelation functions of dead leaves image ensembles of different 
opacity levels differ only by a multiplicative constant for power-law object size distributions. The 
2-point functions are power law functions of distance, with power ~ —0.2, in good agreement 
with our analytical calculation. (E) Similarly, the power spectra of these image ensembles are 
roughly power-law functions and are all the same up to a multiplicative constant. The ratio of the 
opaque and most transparent power spectra is nearly flat. At relatively high spatial frequencies 
(above ~ 20 cycles/image), corresponding to small length scales, the q S> so approximation in our 
analytical calculation fails, and slight deviations from power-law power spectra can be observed, 
as can deviations from constancy in the ratio. 

We will compute (I(x) 2 ) and C(q) recursively by noting that adding another leaf to an 
image creates a new image from the same transmissive dead leaves ensemble and thus the 
(average) statistical properties must remain unchanged by this transformation^. 
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Using Eq. (1), we can compute the pixel variance 

[l 2 (x)) = (l-P m )(l 2 (x)) (2) 
+ P in ({al{x) + {l-a)bf) 

1 >' ~ 1 - (a*) ' 

where Pi n is the probability that the point in question falls within the newly added circle. 
The quantity Pj n , and thus the distribution of circle sizes, does not affect the pixel variance. 
It will however, affect the spatial properties of the image, including C(q). 

To compute C(q), consider how the pixel values of a pair of points with separation q are 
affected by the addition of a new leaf. After adding the leaf, either one, both, or neither 
of the sample points lie under the leaf, resulting in three different possible modifications to 
the pixel values (Eq. 1). These outcomes occur with probabilities Pi(q), ^((z), or Po(q), 
respectively, which we will later compute. Equating the 2-point functions before and after 
the addition of a new leaf, we obtain 

C(q)= P (q)C(q) + P^q) ([al(x) + (1 - a)b] I(x')) 
+ P 2 (q)([al(x) + (l-a)b)[al(x') + (l-a)b}). (3) 

Recalling the definition of the autocorrelation function and the normalization Po(q)+Pi(q) + 
^2(9) = 1, we find 

da) = mi^nm U) 

{Q) P 1 (q)(l-a) + P 2 (q)(l-a^y U 
The quantities (b 2 ), (a 2 ), and (a) depend on the distributions of circle brightnesses and 

opacities. 

To calculate Pi(q), we first define P* = (s 2 ) /L 2 , which is the probability that any given 
point in the image falls within a newly-deposited leaf. Here L is the diameter of the circular 
image area, s is the diameter of the newly added circle, and we assume (s 2 ) L 2 . The 
probability P\{q) that either point, but not both, falls within the circle is then P\{q) = 
2 (P* — P 2 (q)), where the factor of 2 comes in because there are two such points to consider. 

To determine the probability P2(q), note that, for a circle of diameter s, given that one 
particular point x is within the circle (which occurs with probability s 2 /L 2 ), the probability 
that another point, a distance q away, is also within the circle, is given by^g(q/s G [0, 1]) = 

and thus 



cos \q/s) - {q/s)y/l - {q/sf 



P2{q) = J T2 9{q/s)p{s)ds. (5) 



For a power law size distribution p(s) = (A/so)(s/so)~ a , where a > 3, A is a unitless 
normalization constant, and So is the small-size cutoff, the change of variables u = s/q in 
the above integral yields 

PM = A (±Y^ r g{l/u)u 2 - a du. (6) 



LJ \s J Ji 

Define the integral to be B(a). For pixel separations much larger than the small-size cutoff 

A ( so' 
a-3\L 



of our leaf diameter distribution, q ^> sq (in which case P* = -4^ (y) ^> P 2 (q)), Eq. (4) 



becomes 

_ B(a) (a -3) (fe 2 ) ((1 - a) 2 ) / q \ "(-3) 

yielding an image power spectrum^ V(k) oc — -hz^ k~( 5 ~ a ^ in which the opacity affects 
the power spectrum only as a multiplicative prefactor. When a = for all circles (opaque 
limit), our result is equal to that of RudermarP^, as it must be. Also note that, as one might 
expect, the 2-point function does not depend on the size L of the image surface. 

To demonstrate that leaf opacity can affect the functional form of the 2-point function, 
we repeat the above calculations with size distribution p(s) = 5(s — s*), in which case the 
correlation function is 

cm = '^y^y , ( 8) 

which depends non-trivially on a: for q > s*,g(q/s*) = and the correlation function 
vanishes, so the large-g limit in which Eq. (7) was derived is irrelevant for delta-function 
size distributions. 

A comparison of Eqs. (2) and (7) shows that the pixel variance, and the image auto- 
correlation function, are multiplied by different opacity dependent pre-factors. For q = 0, 
the variance and the 2-point function are equal, so the fact that for q 3> Sq, they scale 
differently with changing opacity highlights that there is a qualitative change in the 2-point 
function near the q ~ So boundary. For natural images, the minimum object size is much 
smaller than our cameras can resolve, so this boundary is never encountered in practice. 
Furthermore, this comparison demonstrates that not all image statistics vary in the same 
way with changing leaf opacity. 



III. ANALYTICAL CALCULATION OF THE 4-POINT FUNCTION FOR 
COLLINEAR POINTS IN THE TRANSMISSIVE DEAD LEAVES MODEL 



As we have seen, the form of the 2-point function is independent of leaf opacity for power- 
law object size distributions. At the same time, the images generated with different leaf 
opacities (Fig. 2) are visibly different, so there must be some difference in the image statistics 
(aside from the overall pixel variance) from ensembles with different object opacities. To 
understand this difference, we consider higher-order statistics beyond the 2-point function. If 
the leaf brigthnesses (b) are symmetrically distributed about zero, then the 3-point function 
will vanish, and so the next possible candidate beyond the 2-point function is the 4-point 
function. 

In this section, we will compute the 4-point function Cf ll (x, x', x", x'") = {I(x)I(x')I(x")I( 
for equidistant collinear points; \x — x'\ = \x' — x"\ = \x" — x"'\ = q and \x — x"\ = \x' — x'"\ = 
2q, for the dead leaves model with power-law leaf size distribution. We chose this arrange- 
ment of points because it considerably simplifies the analysis of the 4-point function, for 
reasons that will become apparent during the calculation. Nevertheless, the calculation 
itself is still somewhat tedious, so some readers may wish to skip to the result at the end of 
this section. 

As in the case of the 2-point function described above, since our image ensemble is 
invariant under translations and rotations, the result depends only on the pixel spacing q: 
Cf u {x, x', x", x 1 ") = Cl° u (q). We apply the same recursive logic that we used for computing 
the 2-point function in order to infer the 4-point function, and start by enumerating all of 
the possible modifications to the 4-point function upon the addition of a new circle. We will 
number the points from left to right. Thus, 

Cf\q) = Pf\q)Cf l {q) 

+ Pff(q) (ial(x) + (1 - a)b] I(x')I(x")I(x"')) 
+ Pff(q) (m [al@) + (1 - a)b] I(x")I(x"')} 
+ Pg{d) (mm W) + (1 - a)b\ I(x'")) 
+ Pff(q) (I(x)I(x')I(x") [al(x>") + (1 - a)b}) 
+ P?f(q) ([al(x) + (1 - a)b] [al(x') + (1 - a)b] I{x")I{x"')) 
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+ P^iQ) (iffl [altf) + (1 - a)b] [al(x") + (1 - a)b] /(£"')) 
+ Pzf{q) (l{x)I{x') [al{x") + (1 - a)b] [al(x"') + (1 - a)b}) 
+ PifM ([al{x) + (1 - a)b] \al(x') + (1 - a)b] \al(x") + (1 - a)b] I{x"') 



+ 



P SM (Hx) [al{x>) + (1 - a)b] [al{x") + (1 - a)b] [al{x 7 ") + (1 - a)b 



+ ^2,3,4(9) \[al(x) + (1 - a)6] [a/(x') + (1 - a)b\ [al(x") + (1 - a)6j [a/(x w ) + (1 - a)b 
where Pf°" is the probability that none of the four collinear points fall under the newly- 



deposited circle, is the probability that only the r" point falls under the newly-deposited 
circle, Pf° u is that probability that only the i th and j th collinear points fall under the 
newly-deposited circle, and so on. Because the points are collinear, it is impossible for non- 
neighboring pixels to fall under a given circle unless all of the pixels in between them also 
fall under that circle. Hence, there are no terms like P^ 1 or P{°^ in the above equation, 
since they would require there to be "gaps" between neighboring pixels. Alternatively, one 
can include those terms but note that the probabilities associated with them are zero. 

To simplify Eq.(9) to the point that we can easily solve for C2° ll (q), we will first expand 
and simplify all of the average products (■), then compute all of the probabilities Pff, and 
finally assemble all of these pieces. 



A. Expanding and simplifying the average pixel-value-products 

Since the circle brightnesses b are zero-mean and independently drawn, each of the terms 
in which a single pixel is modified (the second through fifth terms in Eq. (9)) reduces to 
(a) -Pf^" C%° 11 (q) . Similarly, expanding the terms in which 2 points fall under the circle (the 
sixth through eighth terms in Eq. (9)), recalling that (b) = 0, and performing a bit of 
algebra, each of those terms can be simplified to 



pcoll 



1,3 



a 2 ) Cf\q) + Ul - af) U?) C 2 (\k - m\q) 



(10) 



where k 7^ m, k,m e {1, 2, 3, 4}\{«, j}, C2Q is the 2-point function that we calculated in 
the previous section (Eqs. (4) and (7) for power-law object size distributions), and we now 
denote it with a subscript 2 to avoid confusion with the 4-point function. 

Assuming that the circle brightnesses are symmetrically distributed about zero (and thus 
(6 3 ) = 0), the Pf° u k terms in which 3 points fall under the circle reduce to 
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P$.(Q) [(« 3 > Cf\q) + (a(l - a) 2 ) (6 2 ) (C 2 (g) + C 2 (2q) + C 2 (3<z))] . (11) 
Finally, the last term in Eq. (9), in which all 4 points fall under the new circle, simplifies 



to 



P$kM (« 4 ) CT (?) + <« 2 (1 - a) 2 } W (3C 2 (?) + 2C 2 (2g) + C 2 (3g)) + <(1 - a) 



,2,3,4V 



4\ r>coll< „\ i „2(-i „\2 



(12) 



B. Computing the probabilities P^ 1 

We now require the probabilities P CO ", Pg', P 2 ra ", PfJ, P 2 c f, Pg 3 , and Pg^. The re- 
maining probabilities in Eq. (9) are equivalent to these because of the symmetry of the 
arrangement of points (and of the image ensemble). 

Because all intervening pixels must lie under the circle if the bounding ones do, P{°\ \ 4 ((?) = 
P 2 (3g), where P 2 (.) is the probability that 2 pixels of a given separation lie under the same 
circle, and is calculated in the previous section (Eq. (5) for power-law distributions of circle 
sizes). We will use similar arguments to obtain the other 6 probability functions that we 
require. 

The "triplet" probability P?$ l 3 (q) is thus given by the probability that 3 of the (adjoining) 
pixels fall under the circle, minus the probability that all four pixels fall under it: Pi° 2 ll 3 = 
P 2 (2g) - P 2 (3q). And by the same logic, P{f = P 2 (q) - P 2 (2q). 

For the "inner" pairs, we compute the probability of the 2 "inner" points falling under 
the circle minus the probability that those two points and any adjoining ones all fall under 
the circle. Thus, 



PSflti) = P2(q) - P& ~ PSSi - P&A ( 13 ) 
P$\<l) = HQ) - 2^(2g) + P 2 (3g). 

Similarly, P{°^{q) = P* — P 2 (q), where P* = (s 2 ) / L 2 is the probability of any given point 
falling under the newly-deposited circle, and 
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(?) = p* - Pif(v) - PSiv) - p^M - P SM) - p i%,M ( 14 ) 

P%t l (Q) =P*~ 2^2 (?) + P 2 (2q). 

Finally, 



Pf\q) = 1 " E " E Pi? (?) - E ^$(?) - ^w(?) (is) 

i ij^i i,j^=i,k^i,j 

Pf\q) = l-AP* + W 2 (q). 



C. Assembling the pieces to find Cl° ll (q) 

Before substituting all of our results into Eq. (9) and solving for Cf ll (q), it will be useful 
to first consider the q 3> So limit, in which we derived the 2-point function. In that limit 
(Eq. (6)), 

P 2 (q) = AB(a) (|) 2 (f)" (a_3) «1 (16) 



CM = BUia-mil-a?) ( q_y^ <K lf 



and 



2(1 -a) Vs , 
so only the lowest-order terms in these quantities need to be considered. Because of 

the power-law nature of these functions, C 2 (2q) and P 2 (2q) have the same dependence on 

distance q as do the C 2 (q) and P 2 (q) terms, but are smaller by a factor of 2~( a ~ 3 \ and 

similarly for the f(3q) type terms. 

Substituting all of the products and probabilities derived in the preceding subsections into 

Eq. (9), keeping only the lowest-order terms in (q/so)~^ a ~ 3 \ which dominate for q s , 

and solving for Cf ll (q), we find that 



crM ,%)(»-3)W[i-.n /ggy'^ (18) 



4(1 -a) \s , 
Thus, the 4-point function for this arrangement of points (in the q 3> So limit) has the 
same power-law form as does the 2-point function (Eq. 7), and it also only depends on 
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opacity by a multiplicative pre-factor. Given that this (collinear) arrangement of points is 
so similar to the arrangement of points in the 2-point function (two points will always be 
collinear), this result is perhaps unsurprising. To test the generality of this result, we will 
compute the 4-point function for a square arrangement of points in the next section. 

IV. ANALYTICAL CALCULATION OF THE 4-POINT FUNCTION FOR 
A SQUARE ARRANGEMENT OF POINTS IN THE TRANSMISSIVE 
DEAD LEAVES MODEL 

In this section, we calculate the 4-point function for our transmissive dead leaves en- 
semble, for the case in which the 4 points lie on the vertices of a square with edge length 
q. Similar to the collinear arrangement of points, the symmetry in this arrangement will 
greatly simplify our calculations and, since it has non-trivial geometry when compared to 
the collinear arrangement, there is a possibility for interesting features to arise in this 4- 
point function that are not apparent in either the 2-point function, or the 4-point function 
for collinear points. 

We will label these points 1, 2, 3, 4, going clockwise, and beginning in the upper left-hand 
corner. Similar to the calculation for the collinear case, we first list all of the possible 
modifications to the 4-point function, and the probabilities with which they occur. We will 
then simplify this expression, calculate the relevant probabilities, and use recursion to solve 
for the 4-point function. Similar to the previous calculations, the translation and rotation 
invariance of our image ensemble means that this 4-point function will depend only on the 
edge length of the square: Cl quare (xi, x 2 , x 3 , £4) = C'l quare (q) . 

Enumerating all possible modifications caused by the addition of a new circle, we find 
that 

Cf uare (q) = P s quare (q)Ct quar \q) 

+ 4P— (q) ([olfr) + (1 - a)b] I(x 2 )I(x 3 )I(x 4 )) 

+ AP^ are {q) ([olfa) + (1 - a)b] [al(x 2 ) + (1 - a)b] I{x 3 )I{x,)) 

+ 4Pr|X e (9) ([a/(a?i) + (1 - a)b] [al(x 2 ) + (1 - a)b] [al(x 3 ) + (1 - 0)6] 7(x 4 )> 

+ P$£l(q) ([al(3i) + (1 - a)b] [al(x 2 ) + (1 - a)b] [al(x 3 ) + (1 - a)b] [aI{x A ) + (1 
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where P0 quare (q) is the probability that none of the four corners of the square fall under 
the newly-deposited circle, p^ uare i s the probability that only the i th corner falls under the 
newly-deposited circle, P t sq . uare i s that probability that only the i th and j th corners fall under 
the newly-deposited circle, and so on. The symmetries in the square configuration (all edges 
are equivalent, and all corners are equivalent) allow us to collapse the (equivalent) p^ uare 
terms, and similarly for the p^ uare terms and the Pt q ^ re terms. We further note that terms 
like p i s | uare anc i p|| uare ; which contain opposite corners of the circle, are omitted because it 
is impossible for a circle to cover diagonally opposite corners of the square without covering 
at least one other corner. The factors of 4 in the above equation come in because there are 4 
corners to a square, and 4 edges to a square, and = 4 different ways to choose groupings 
of three of the four corners. 

We can expand and simplify the averages of the products of the pixel values, as in the 
previous section, to find 



Cf uare (q) = P s quare {q)Cl quare {q) 

+ A(a)P^ uare (q)Cl quare (q) 



(20) 



a 2 ) a 



square 



(q) + ((1 - a) 2 ) (b 2 ) C 2 (q) 



+ 4P 1 s J are (g) 

+ PiKsAiq) [(a 4 ) C s r are (q) + (a 2 (l - a) 2 ) (b 2 ) (±C 2 (q) + 2C7 2 (V2?)) + ((1 - a) 4 ) (b* 



C square {g) + ^ I ^ _ fl)2 \ A 2 \ ^ + / (1 _ fl)2 \ A 2 \ 



where the function C 2 (-) is the 2-point function we discuss in Eq. 7. 



A. Computing the probabilities p^ are 

To finish our calculation of the 4-point function for square geometries, we require the 
probabilities P squar e (q), P^iq), P^iq), P%T(q), and P$%Z(q). 

For the calculation of °'(q) , we first note that, given that one of the corners of the 

square falls under a newly-deposited circle (with diameter s), the probability that all 4 points 
fall under it is g 4 (q/s e [0, l/y/2]) = | [cos'^q/s) - (tt/4) + (q/s) 2 - (q/s)y/l - {q/sf 

Using the same logic (and variable substitution) as in Eq. 6, we find that 
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poo ^2 

p^m(q) = I T M<i/ s )p( s ) ds (21) 



(22) 



where B 4 (a) = §^g±{l/u)u 2 ~ a du. 

To derive Pl q 2 u ^ rt : (<?) , we seek the probability that 3 of the points, but not all 4, lie under 
the newly-deposited circle. If the two diagonal points are under the circle, so will at least one 
of the corners, and thus Pt q 2 ™ re {q) = (P2(V2q) - P$£™ (q)) /2, where P 2 {x) is the probability 
that two points a distance x apart lie under a newly-deposited circle, and is calculated in 
Eqs. 5 and 6 (above). 

The "doublet" probability Pl q 2 are (q) is the probability that 2, but not 3 or 4 of the points 
fall under the circle, and thus is given by P^ are (q) = P 2 (q) - P$$ re (q) ~ P$$ re (q) ~ 
P^:{q)=P2{q)-P2{V2q). 

The "singlet" probability P^0 are (q) is the probability that 1, but not more, of the points 
fall under the circle, and is thus given by P^ are (q) = P* - P^ 2 are (q) - P^T^q) - 
P&T(q) - PftFia) - AXT e (<?) - P$£Z(q\ where P* = ( S 2 )/L 2 is the probability 
that a newly-deposited circle covers any given point, and is calculated in the previous 
sections. Simplifying this expression using our previously-derived results, we find that 

Finally, the probability that none of the points falls under a newly-deposited circle is 

t j-,square i \ i j-,square i \ v-^ j-,square v-^ j-)Square j~,square 

given by P q (q) = 1 - Ei^J (<?) - Eij^^j - Eij^^j ^j )fc - ^1,2,3,4 = 
l-4P* + 4P 2 ( g )-P 1 X7(?)- 

B. Combining the pieces to find Cl quare (q) 

As in our calculation of the 4-point function for collinear points, we again consider the 
q/ s o ^ 1 limit, in which we need only consider the lowest-order terms in (g/so) - *"" 3 '*- 111 
that limit, we find that 



Cr are {q) ^ B,{a) (q - 3) (fe 4 )((l-a) 4 ) \-(-3) ^ ^ 

4 (1 — a) \S(v 
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Like the other n-point functions computed thus far, the 4-point function for square geome- 
tries is a power law with power —(a — 3), and it depends on opacity only as a multiplicative 
pre-factor. We note that, for a = 3.2, B(a) ~ 4.014, while B^ot) ~ 3.581, where these 
values come from numerical integration using Simpson's method. These values are similar 
in magnitude, and thus the 4-point function is not inherently much smaller than the 2-point 
function. 

Finally, we note that the 2- and 4-point functions depend differently on object opacity, 
and thus the visible difference in the different image ensembles likely arises from the relative 
amplitudes of these (power-law) functions, and not any difference in their functional forms. 

V. NUMERICAL ANALYSIS OF THE TRANSMISSIVE FALLEN-LEAF 
IMAGES 

To confirm our analytical calculations of the 2-point functions, we simulated 500-frame 
ensembles of 256 x 256 pixel images, using the procedure described in Eq. 1: circles of 
random size (following a power law distribution p(s) oc s -3 ' 2 above the cutoff of Sq — 1 
pixel), brightness, and position were iteratively placed on the image frame to build up the 
images. For each frame, 10 6 circles were deposited, which is the number required to cover 
the image surface ~ 100 times. 

To avoid edge effects, circle centers were allowed to fall up to 256 + s/2 pixels away 
from the center of the image frame, where s is the circle diameter in pixels. We used a 
large maximum circle size, s max = 10 8 pixels, because prior workP^ G n dead leaves models 
found that the functional form of the measured autocorrelation function approaches the 
analytically calculated curve only in the s max — > oo limit. The heavy tail of the power-law 
distribution contains a non-negligible number of very large leaves, which contribute to the 
long-range correlations in the images. 

We then measured the difference functions D(q) = (jl(x) — I(x')\ 2 ^ = 2 (I(x) 2 } — 2C(q) 
for the image ensembles. D(q) is clearly related to the autocorrelation function C(q), but 
is easier to measure^ as it is unaffected by the mean values of the individual images. We 
fit the measured difference functions to power law functions of the form D(q) = rj x g M + u, 
as is suggested by our analytical calculations (Eq. 7). The best-fit parameters (r/,/i, v) for 
the image ensembles with a = {0,0.25,0.5,0.75} were (-0.48 ± 0.01, -0.24 ± 0.04,0.69 ± 
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FIG. 3. For delta-function object size distributions, opaque and transmissive dead 
leaves images yield different 2-point statistics. (A,B) Sample images in which the leaves are 
all the same size (s* = 25 pixels), from opaque (a=0, A) and transmissive (a=0.75, B) ensembles. 
(C) The autocorrelation functions of these image ensembles do not follow power laws, and they 
differ from one another. (D) Their power spectra also differ non-trivially: the ratio between the 
power spectra is not constant. The ripples are at multiples of the 256/25 ~ 10 cycles/image 
frequency imposed by the uniform circle size. 

0.03), (-0.32 ± 0.01, -0.23 ± 0.03, 0.41 ± 0.02), (-0.191 ± 0.004, -0.22 ± 0.03, 0.23 ± 0.01), 
(-0.086 ± 0.002, -0.21 ± 0.02, 0.098 ± 0.005), respectively, where the uncertainties represent 
95% confidence intervals. These values are in good agreement with the analytical calculations 
that predict = —0.2 for all ensembles, and v = {0.66, 0.396, 0.22, 0.094} for the ensembles 
with a = {0,0.25,0.5,0.75}, respectively. The correlation functions shown (Fig. 2D) are 
the measured difference functions subtracted from the constants v measured in the fit: 
C{q) = [ u ~ D(q)]/2. These correlation functions are power-law functions of distance (linear 
on the log-log plot), and differ by a multiplicative constant. Similarly, the power spectra 
of the image ensembles (Fig. 2E), differ only by a multiplicative constant for low spatial 
frequencies, where the q^> sq approximation holds. 

Fig. 3 demonstrates that the 2-point function is affected substantially by leaf opacity for 
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delta-function size distributions. In particular, the modulation depth of the "ripples" in the 
power spectra depend on the leaf opacity, and thus the opacity does not modify the power 
spectra simply by a multiplicative factor. The procedures used to generate the data shown 
in Fig. 3 were the same as for the power-law object size distribution, except for the different 
distribution of object sizes. 

VI. A MORE REALISTIC MODEL OF RADIOLOGICAL IMAGES 




10 25 50 100 200 300 10 ° 10 ' 

Distance (pixels) Spatla | Frequency ( cycles / image ) 



FIG. 4. A shadowing dead leaves model with finite optical depth also exhibits scale 
invariant 2-point statistics for power law object size distributions. (A) An example image 
from a dead leaves model with the same power law distributed leaf sizes as in Fig. 2, in which each 
leaf leaves a shadow by multiplying the brightness of the pixels it subtends by a factor no greater 
than one, drawn uniformly within [0.5, 1]. Unlike the previous models, each pixel starts out at full 
brightness, and only a finite number of circles is added to generate the image. The autocorrelation 
function (B) and power spectrum (C) of this ensemble show scale invariance (for relatively low 
frequencies, which corresponds to q 3> so), just like the previous models. 

Our transmissive dead leaves model is not a perfect model for radiological images. Im- 
age formation in mammograms and other projectional radiographs results from the partial 
blockage of a roughly uniform illumination of x-rays due to local regions of dense tissue, 
unlike our dead leaves model. Moreover, imaged tissue is typically much thinner than the 
path length required to fully block the x-rays throughout the image, unlike the effectively 
infinite optical depth of our "additive" transparent dead leaves model (Eq. (1)). 

It is thus natural to ask whether our conclusions about variable object opacity generalize 
to these types of images. Analytically computing the 2-point statistics for this radiographic 
model is more involved than for the infinite depth models, since recursion is more complex 
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in this case. For this reason, we chose to verify via simulation that the qualitative results 
from our analytical calculations hold for these types of images. 

Fig. 4A shows a typical image from a shadowing dead leaves model with finite optical 
depth and the same power law leaf size distribution as in the previous models. To generate 
these model images, a uniform background illumination (of 1) was imposed across the whole 
image. Randomly sized and located circles were then deposited onto the image plane, with 
each leaf multiplying the brightness of the pixels it subtends by a factor drawn uniformly 
within [0.5, 1]. The circle sizes were drawn from the same power law distribution as in the 
previous simulations, and the simulation code was thus very similar. 

For an ensemble of these "radiographic" images, the empirically measured 2-point func- 
tion (Fig. 4B) and power spectrum (Fig. 4C) exhibit the same power laws as we found for 
our previous models (Figs. 2,3), suggesting that our calculation holds more generally than 
for the specific model for which we performed the analytical calculations. 

Intuitively, one might expect the same scale-invariant 2-point function for this model as 
for the previous one since no new length scale has been introduced. 

VII. CONCLUSIONS 

For the special case of power-law object size distributions, object opacity does not affect 
the form of either the 2- or 4-point functions, or the power spectrum of images: it is manifest 
only by a multiplicative constant in these power-law functions. Ours is the first analytic 
calculation that demonstrates these facts, and thus deepens our understanding of image 
statistics. 

For object size distributions other than power-law, object opacity can (potentially dra- 
matically) alter the low-level image statistics. Occlusion is important for natural image 
formation, but we find that it does not change the form of the power spectrum. Since 
images formed by opaque leaves that are all the same size have oscillatory, non-power-law, 
power spectra (Fig. 3), and transmissive leaves can yield power law power spectra (Figs. 2 
and 4), occlusion is likely not responsible for scale invariance of images. We propose that 
the universality of power law power spectra in both occlusive imaging environments, such 
as natural photographic images, and transmissive ones, such as mammography, is likely due 
to power-law object size distributions in both settings. 
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